Skip to content

[SQL] Construct the MutableRow from an Array#3217

Closed
chenghao-intel wants to merge 3 commits intoapache:masterfrom
chenghao-intel:mutablerow
Closed

[SQL] Construct the MutableRow from an Array#3217
chenghao-intel wants to merge 3 commits intoapache:masterfrom
chenghao-intel:mutablerow

Conversation

@chenghao-intel
Copy link
Contributor

@chenghao-intel chenghao-intel commented Nov 12, 2014

No description provided.

@SparkQA
Copy link

SparkQA commented Nov 12, 2014

Test build #23238 has started for PR 3217 at commit a751838.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Nov 12, 2014

Test build #23240 has started for PR 3217 at commit 4681aea.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Nov 12, 2014

Test build #23238 has finished for PR 3217 at commit a751838.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class GenericMutableRow(v: Array[Any]) extends GenericRow(v) with MutableRow

@AmplabJenkins
Copy link

AmplabJenkins commented Nov 12, 2014

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23238/
Test PASSed.

@SparkQA
Copy link

SparkQA commented Nov 12, 2014

Test build #23240 has finished for PR 3217 at commit 4681aea.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class GenericMutableRow(v: Array[Any]) extends GenericRow(v) with MutableRow

@AmplabJenkins
Copy link

AmplabJenkins commented Nov 12, 2014

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23240/
Test PASSed.

marmbrus
marmbrus reviewed Nov 14, 2014
View reviewed changes
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Row.scala Outdated
Copy link
Contributor

@marmbrus marmbrus Nov 14, 2014

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you make this private[sql]? I don't think we want to expose mutable rows to users yet as the API is still in flux.

Copy link
Contributor

@marmbrus marmbrus Nov 14, 2014

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

And actually, why is this here as a static method instead of an instance method on Row itself? What is your intended use case?

Copy link
Contributor Author

@chenghao-intel chenghao-intel Nov 17, 2014

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Exposing the mutable row is required in #3247, we want to reuse the row object as aggregation buffer, but you're right, we should make it as instance method on Row itself.

Copy link
Contributor Author

@chenghao-intel chenghao-intel Nov 17, 2014

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, probably I can use the SpecificMutableRow, I will simplify the PR by fixing the GenericMutableRow only.

@chenghao-intel chenghao-intel changed the title [SQL] Construct the MutableRow from an existed row [SQL] Construct the MutableRow from an Array Nov 17, 2014
@chenghao-intel
Copy link
Contributor Author

chenghao-intel commented Nov 17, 2014

Thank you @marmbrus , I've updated the title, and revert the change of the Row object, I will try to use the SpecificMutableRow instead in another case, let's see if there any more issue with that then.

@SparkQA
Copy link

SparkQA commented Nov 17, 2014

Test build #23447 has started for PR 3217 at commit e8a10bd.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Nov 17, 2014

Test build #23447 has finished for PR 3217 at commit e8a10bd.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class GenericMutableRow(v: Array[Any]) extends GenericRow(v) with MutableRow

@AmplabJenkins
Copy link

AmplabJenkins commented Nov 17, 2014

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23447/
Test PASSed.

@marmbrus
Copy link
Contributor

marmbrus commented Nov 18, 2014

Thanks! Merged to master and 1.2

@asfgit asfgit closed this in 69e858c Nov 18, 2014
asfgit pushed a commit that referenced this pull request Nov 18, 2014
@chenghao-intel @marmbrus
[SQL] Construct the MutableRow from an Array
7d04426 
Author: Cheng Hao <hao.cheng@intel.com>

Closes #3217 from chenghao-intel/mutablerow and squashes the following commits:

e8a10bd [Cheng Hao] revert the change of Row object
4681aea [Cheng Hao] Add toMutableRow method in object Row
a751838 [Cheng Hao] Construct the MutableRow from an existed row

(cherry picked from commit 69e858c)
Signed-off-by: Michael Armbrust <michael@databricks.com>
@chenghao-intel chenghao-intel deleted the mutablerow branch July 2, 2015 08:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@chenghao-intel @SparkQA @AmplabJenkins @marmbrus